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ABSTRACT 



The mathematical models of this paper were developed 
as an outgrowth of working with the Comprehensive Achievement 
Monitoring project (Project CAM) which was conceived as a model and 
application of sampling procedures such as those used in industrial 
quality control techniques to educational measurement. This paper 
explores mathematical modeling techniques to gain insight into the 
role of achievement testing in the instructional process. All 
assumptions are listed, three models are presented, and computational 
examples provided. Each model centers on one of the following: 1) 
instruction given in a finite amount of time; 2) instructional 
activities in an in di vidua lly- paced curriculum; and 3) tests used to 
group students tor instruction. (Author/CK) 
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1.0 Introduction 



During the past three years, the author has been working on 
research and development efforts in educational achievement testing. The 
Comprehensive Achievement Monitoring project (Gorth [6] and Pinsky [9,10]) 
that the author is a member of was initiated with the idea of applying 
sampling procedures such as those used in industrial quality control tech- 
niques to educational measurement. Throughout this time, questions have 
arisen such as how long should an achievement test be?; how frequently 
should testing be done?; and what is the value of an achievement testing 
program as compared with its cost? Analogous questions have been asked of 
the sampling procedures used in industrial quality control techniques. 
Mathematical models have been developed to gain insight into the role of 
these sampling procedures in the quality control process (Barlow and 
Proschan [2]). In his Ph.D disserts, cion (Pinsky [9]), the author explored 
the use of these mathematical modeling techniques to gain insight into the 
role of achievement testing in the instructional process. This paper 
presents extensions of the work contained in the dissertation. 

The next section presents the general assumptions upon which all the 
models are based. Model 1 is developed in section 3.0; model 2 is developed 
in section 4.0, followed by computational examples for the model; and model 
3 is developed in section 6.0, followed by computational examples for this 
model. It is the author's intention that these models will be of value in 
gaining insight into the role of achievement testing in the instructional 
process. It is not the author's intention that these models will be applied 
to a real world environment. Much more work is necessary before the latter 
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situation will be productive. 

Some of the assumptions made in this paper are reasonable, and 
some of the parameters defined are easy to estimate. However, some of the 
assumptions made and parameters defined should be examined closely. The 
assumptions about test reliability are straightforward, and the concept of 
test reliability is easily incorporated in the models. The defining of 
student parameters should not cause any major problems. The estimation of 
these parameters is slightly more difficult. The concept of placing a 
monetary value upon certain instructional activities is a relatively 
foreign concept in educational institutions. However, this decade should 
see a considerable effort in the educational community to analyze instruction- 
al alternatives in monetary terms. This is evidenced by the Planned Program 
Budgeting Systems (PPBS) approach that is now getting considerable attention. 
The assumptions about how the achievement test data is used to make instruc- 
tional decisions should be examined carefully. The manner in which test 
data, in conjunction with other data that a teacher has (such as verbal and 
visual cues in the classroom), is used for decision making is not very 
well known. It is hoped that these models will stimulate thought about 
this topic. The final and perhaps most difficult assumption to defend is 
concerned with the curriculum structure and how a student progresses 
through this structure. Extensions of the work presented in this paper 
should concentrate on making more explicit assumptions about the curriculum 
structure, defining the relevant student parameters, and generating models 
of learning within this structure. 
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2.0 Assumptions 

The following general assumptions apply to all three models. The 
time variable can be continuous (denoted by the symbol t ), or discrete 
(denoted by the symbol n ). In the assumptions below, time is represented 
by t, but could also be represented by n . In each of the models, fur- 
ther assumptions are made. 

2.1 Student's state - The student's state at time t is given by 
o(t) . o(t) can be a scalar or vector quantity, discrete or continuous. 
Examples of a student's state include what lessons in a textbook he is 
working on, his grade equivalent in a subject area, his mental ability (IQ) 
score, or his level on each of the strands in Stanford's CAI mathematics 
curriculum (Suppes and Morningstar [11]). 

2.2 Estimation of oCt^) - Testing is done at time t^ . The test 
results generate an estimate e(tQ) of the student's true state o(tQ) . 
The variance of this estimator is called the reliability of the testing 
procedure (Lord and Novick [8]). 

2.3 Change in the student's state - The student's true state e(t) 

changes over time according to a stochastic learning model. One never 
observes o(t), but must make a projection as to what e(t) is given 
that one knows (Ut^) . is the projected student's state based upon 

(i(t^) and the stochastic learning model. However, one never knows 0(tQ)> 
but rather must make inferences from ['(t^) . Correspondingly, 0p(t) is 
the estimated projected student's state. This variable Op(t) is known 
and is used to make instructional decisions. An example of §p(t) is that 
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a student who has just finished lesson 5 at time t^ ~ 

probably have finished lesson 6 by time t^ 

2.4 Instructional decisions - Given the value 0p(t) at time t, 

instructional decisions D(0p(t)) are made. Thus, if 0p(t) 6 (meaning 

that the student has probably just completed lesson 6), then D(0p(t)) = 

D(6) = 7 (meaning that the student should work on lesson 7). D(-) can be 

either a scalar or a vector function. 

2.5 Value of the instructional decisions - Given 0(t), the true 
value of the student's state; Op(t), the estimated projected value of the 
student's state; and D(6 (t)), the instruction decisions; V[D(0 (t))|0(t)] 

K K 

is the value of such a decision,, If the student has just finished lesson 6 
(o(t) = 6) and Is assigned lesson 7 (D(6p(t)) = 7), then the value of 
this instructional decision should be high; while if this student is assigned 
lesson 12, then the value of the instructional decision should be low. 

2.6 Expected value of instruction - It is assumed that testing is 
done every T units of time. Thus, the models have an infinite horizon. 

The expected value of the instructional process from time t^ to time 

to + T is given by 

EV(T) = f {EV[D(o (t) l0(t)]}dt for continuous time 
‘o 

and 

n^+N 

EV(N) = I EV[D(6 (n)) |0(n)] for discrete time. 
n=n„ P 
0 
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The expectation is taken with respect to both the errors of measurement 
for (Mt^) and the deviation of e(t) from Sp(t) • 

2.7 Testing frequency - In order to maximize the expected value 
of the instruction program per unit of time, T* is chosen which maximizes 
the expected value of instruction over an interval of T units of time 
(EV(T)) minus the cost of testing (m) divided by T . That is, 

EV(T*) - m _ max EV(T) - m 
T* “ T > 0 T 



3,0 Model 1 



The first model is a very simple one. This simplicity is necessary 
when one considers a finite horizon model; that is, when instruction takes 
place in a finite amount of time [0,T], and testing is done at times 
t,,..-,t , 0 = t, < • • • < t < T . Both the finite and infinite horizon 
formulations of this model are discussed in detail in the author's disser- 
tation (Pinsky [9]). 

This section presents a summary of the results for the infinite 
horizon formulation. 

3.1 Student's state - A student is assumed to be in state c 
(conditioned) or state uc (unconditioned). The terms conditioned and 
unconditioned are motivated by the terminology of rnatheniatical learning 
theory (Atkinson, Bowers, and Crothers [1]), The student is assumed to be 
in state c when the information about his needs is correct, and to be in 
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state uc when the information about his needs is incorrect. Thus, in 
state c the student is presented materials such that he learns efficient- 
ly, while the student in state uc is presented materials that are not 
what he really needs (for instance, the materials may be too easy or too 
hard) . 

3.2 Estimation of o(t ) - A test is given at time t^ every T 

units of time. The results of this test are used to decide what the 
student will study. If the test results are accurate, then = c . 

If the test results are inaccurate, tlinn 0(1^^) = uc . After each test, 
the probability that a student will be in state c is equal to r, i.e., 
P{o(to) = c} = r . r is referred to as the reliability of the testing 
procedure. One never knows what state the student is in. In this model, 
(Kt^) = c . 

3.3 Change in the student's state - As the length of time increases 

since the last test, the information about the student's heeds becomes less 

accurate. Correspondingly , the materials presented to the student are less 

in accord with his needs. A student who is in state c at time t^ might 

switch to state uc at time t + t . A student in state uc remains in 

0 

state uc until at least the time when the next test is administered. 

This transition of student states is summarized below. 



ERIC 



Plo(t) = c|o(tQ) = c} = 1 - F(t - t^) P{e(t) = cle(tQ) = uc} = 0 

Plo(t) = uc|o(t^) = cl = F(t - t^) P{o(t) = uc|e(tQ) = ucl = 1 
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F(-) is referred to as the failure distribution analogous to similar 
terminology used in models of the failure of mechanical components in 
industrial situations (Barlow and Proschan [2]). Later in this section, 
two forms of the failure distribution will be used: 

(a) uniform F(t) = min[^,l], t^O 

(b) exponential F(t) = 1 - e"^^, t ^ 0 . 

Orie never knows if the student's true state changes. In this model, 

6p(t) = c all the time. 

3.4 Instructional decisions - Since e„(t) = c, the instructional 

P 

decisions are always the same - D(6 (t)) = D(c) :h D . 

P ^ 

.3.5 Value of the instructional decisions- The value of the instruc- 
tional decisions is given by 



1 if e(t) = c 

V[D(6p(t))|6(t)] = V[Dj6(t)] = 

a ife(t) = uc, 0^ct<l 

Thus, a student in state c learns at a rate of 1 per unit time, while a 
student in state uc learns at a rate of a per unit time. 

3.6 Expected value of instruction - The value of the instructional 
program has two sources of variance. The first is the probability of initial- 
ly being placed in state c, and the second is the probability of transfer- 
ring from state c to state uc at time t . With t^ = 0, one obtains 
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EV(t) = /[PCoCt) = c} • 1 + P{o(t) = uc) • a]dt 
0 

P{o(t) = c} = r • (1 - F(t)) 

P{o(t) = uc} = (1 - r) + rF(t) 



thus 



EV(t) = [a(l - r) + r]T - r(l -a) /^F(t)dt . 

0 

3.7 Testing frequency - 

(a) Uniform failure distribution 



EV(T) = [a(l - r) + r]T - 



r(1 - g)T^ 

2b 



for T < D 



= „(1 . r) . r - 

Taking the derivative of the above with respect to T, 
zero, and solving for T yields 



m 

T 



setting it equal to 



T* _ 2mD 
^ - iTTrr 

This solution only holds for 
(b) Exponential 



\ 1 
r 

^ I 

T* . 

failure distribution 
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.-AT T 

EV(T) = [a(l - r)+ r]T-r(l - a)£T+ ~-] 

EV(T) - m M \ \ /■> - 1) 

— = a(l - r) + r - r(l - a) - r(l - a)-^ - 



Taking the derivative of the above with respect to T and setting it equal 
to zero, yields the following equation for T* 



(1 + AT*)e“^^* = 1 



A m 

■ (1 - a)r • 



The author has been unable to find any closed form solution of T* from 
this equation. 



4.0 Model 2 



The second model is concerned with tests that are used to direct 
individual students' instructional activities in an individually-paced 
curriculum. Examples of this type of instructional program include Indivi- 
dually Prescribed Instruction- IPI (Cooley and Glaser [3]), Planned Learning 

in Accord with Needs - PLAN (Flanagan [5]), and Stanford's CAI strands 

... ^ 

curriculum (Suppes and Morningstar [11]). 

4.1 Student's state - In this model the student's state is a one- 
dimensional variable that is related to his achievement level in the subject 
area. In the computational example presented in the next section, the 
curriculum content ranges from kindergarten to the sixth grade, and a 
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student's state can range from 000 (the entry level in the kindergarten) 
to 699 (the exit level from the sixth grade). Thus, the state variable 
is approximately a grade equivalent achievement level for a student. 

4.2 Estimation of o(tQ) - A test is given to a student at time 

t^ every T units of time. ^Ct^) is the estimate of 0 (Tq) that is 

2 2 

generated by the test data. It is assumed that o(tQ) ~ N(e(tQ),a^). 
is referred to as the reliability of the test. 

4.3 Change In the student's state - o(t) is assumed to change over 
time according to the following linear learning model. 

a(t) = o(t^) + a(t - t^) + e(t - t^) t ^ t^ 

where c(t - t^) ~ N(0,o^(t - t^)) . 

(jp(t) = the projected student's state = E(e(t)) = 0(tQ) + ct(t - t^) 

2 2 

Thus, o(t) ~ N(0p(t), a^(t - t^)) . is an indicator of how accurately 

one can predict a student's achievement level over time in the curriculum 

structure. 0p(t) = the estimated projected student's state = 0(tQ) + 

•x(t - t^) ~ N( 0 p(t),a^) . Define a new variable 0^(t) = o(t) - 0p(t) - 
2 2 

N(0,i>^ + 0 ^ (t - t^)) . This variable is the difference between the student's 
true state and the estimated projected student's state. 

4.4 Instructional decisions - Given knowledge that the student's 
true state o(t) = X, one would want to provide the student with instruc- 
tional materials related to the curriculum content slightly more difficult 
than X . An instructional decision of X means providing materials rela- 
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ted to the curriculum content slightly more difficult than X • Thus 



4.5 Value of the instructional decisions - The value of instruction- 
al decision X for a student in state Y depends upon the closeness of X 
and Y . The value of presenting a lesson on curriculum content 425-430 
to a student in state 425 is high, while the value of presenting this 
lesson to a student of state 300 or state 600 is quite low. The value 
function chosen for this model is 



4.6 Expected value of instruction - Assume "" 0 The remain- 
der of this section. The expectation of the value of instruction is taken 
with respect to two variables, e(t) and ^(t^) 



D(flp(t)) = (3p(t) . 



V[D(6p(t)) lo(t)] = ae 



-b(o(t) - 5p(t))2 




Using the variable transformation o^(t) = o(t) - 0p(t) and using the 
properties of the normal distribution 



EV[-1.] = ae 



-bOj(t) 



f(0d(t)) dOd(j) . 



ERIC 
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Since o^(t) ~ N(0,a^ + a^t), the above equals 



= a[2b(a^ + a^t) + 1] 



• 1/2 



Then 



T 2 2 

EV(T) = /’a[2b(a^ + a'^t) 1 ] dt . 

0 



2 2 

Using the variable transformation Y = 2b(o^ + o^.t) + 1, one obtains 



a ^ P 2 ■'/2 2 ■'/ 2 ' 

EV(T) = [2b(a^ + o^T] - [2ba^ 1] 

ba,. 



4.7 Testing frequency - The optimal testing frequency T* in this 
model is that value of T which maximizes 

1/2 , 1 / 2 - 



(4.7.1) 



mn. 



m 



a 2 2 '/^ 2 '/^) 

^ [2b(a2 a^T) + 1] -[2ba2 + l] j. 



m 



T 



The author could find no closed form solution for T* . The next section 
presents a computational example of the above function. 



5.0 Computational Example for Model 2 

A computer program was written to find T*, the optimal testing 
frequency for model 2, as a function of the various parameters of the model. 
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Upon examining equation (4.7.1), one notices that T* is a function of 

2 2 

only three variables, m/a, ba^, and ba^ . The following thoughts went 
into the selection of the parameter values used in the examples. 

(a) The student state and curriculum content are numbered from 

000 to 699 . 000 is the entry level for kindergarten , while 699 is the 

exit level from the sixth grade. 

(b) Time is in school days. 180 school days to the year times 7 
school years equals 1260 school days from kindergarten through the sixth 
grade. 

(c) If the average student enters level 0 and leaves level 699 
over a seven year period, then a = .55 . 

(d) $100-$150 per student per subject area per year is approximately 
what most school districts spend. Thus a maximum value of $1 per day for 

instruction in a subject area was chosen, a = 1 

2 2 

(e) = 1 implies an excellent test while = 100 implies a very 

poor test. 

2 

(f) a = .02 implies a curriculum and student population that 

2 

allows for very accurate prediction of student achievement, while a = 2.0 

C 

implies a curriculum and student population for which accurate prediction 
is not possible. 

(g) A value of b = .05 was chosen. 

(h) The cost per test per student (m) ranges from $.10 to $.90. 

The results of the computer analysis are shown in Table 1. For 

2 2 

each of the 5 values of ba^, ba^, and m/a, the computer calculated 
equation (4.7.1) for T = 1 to 100 in steps of 1 and found the optimal 
testing frequency T* . The number in the left of the brackets is T*, 
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while the number in the right of the brackets is the value (in cents per 
day) of the instructional program with a testing frequency of T* . A 

in the brackets means that T* was not found in the calculations, i.e., 
T* ^ 100 . Table 1 allows one to do a sensitivity analysis of the param- 
eters in model 2. Note that the value of the instructional program seems 
to be more sensitive to the reliability of the testing procedures (bo^) 
than to the cost of testing (m) or the predictive power of the student's 
achievement level (bo^) . Figure 1 contains a graph of ^ as 

a function of T for a = 1, b = .05, = .03, bo^ = .5 and m = .70 . 



6.0 Model 3 



The third model is concerned with tests that are used to group 
students together for instructional activities. For each unit of curricu- 
lum content, there may be several different instructional activities. In 
many instances, these activities vary in their difficulty level. Examples 
of this type of instructional program include tracking systems that place 
each student in a certain difficulty level of instructional activities and 
periodically change the student's level when his achievement results 
change, and Stanford's CAI block structure curriculum (Jerman and Suppes 
[7]). The time variable in this model is discrete and is labeled as 
n = 1,2,3,*‘* This time variable corresponds to school days. 

6.1 Student's state - During each time period (or day), the student 
is assumed to be in one of S states, i.e., 0(n) e {1,.**,S} . This state 
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variable corresponds to the instructional activity that is best suited for 
the student's needs. There are S instructional activities available in 
the model . 



6.2 Estimation of o(n ) - A test is given to each student at the 

0 

end of time period n^ every N units of time. The test results are used 
to place the student in the instructional activity that appears best suited 

for his needs. Thus c {1,---,S} . Given that a student is actually 

in state o(nQ) = J. the test will place him in state = k with 

probability r.., 7 r . . = 1 , j = 1 , . . . ,S . is referred to as the 

jK|^_lJK JK 

reliability matrix of the testing procedure. 

6.3 Change in the student's state - A student in state j at 

time n transfers to state i at time n+1 with probability p. , 

J ^ 

s 

P- = 1 , j = 1 ,. . . ,S . (p^J is referred to as the student transition 

matrix. The states are labeled such that p.. ^ ~ 1,...,S . A 

student who is assigned instructional activity k at time n^, remains 
in activity k until the next test. Since testing is done every N units 

of time, Op(n^ + n^) = n^ = 0,...,N-1 . 

6.4 Instructional decisions - A student with parameter Op(n) = k 

is assigned instructional activity k; that is, D(6p(n)) = 6p(n) . Testing 
is done to determine what activity is best for each student, and the student 
is kept in that activity until another test is given. 

6.5 Value of the instructional decision - A student in state 

(o(n) = V.) y and in instructional activity k, (Op(n) = k) has a value V^|^ 



O 
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that is, 



V[D(Op(n)) = klo(n) = (^] = . 

It is assumed that V^j^, k = 1 ,. . . ,S . 



6.6 Expected value of instruction - In order to calculate the 
expected value of instruction, one must know the percentage of students who 
are in each of the S states. Let it. be the percentage of students in 

J 

state j . Since the model being considered is an infinite horizon one, 
the IT. should be the steady state probabilities of the student transition 
matrix • (This model contains a finite state Markov chain. The 

properties of a finite state Markov chain that are used in this paper came 
from Chapter XVI of Fellar [4].) After a test is given and the student 
assigned to instructional activities, the value per unit time is given by 



This expression results from a student in state j (which has probability 

iij ) being assigned to activity k (which has probability r^j^ ) which 

has a value of Vjj^ . Between time periods n^ + 1 and n^ + 2, the 

student's state changes from state j to state £ with probability p. , 

J ^ 

The student, however, remains in activity k . Thus the value per unit 
time at time + 2 is 
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In general, the value of the instructional program per unit time n units 
of time after testing is given by 



(6.6.1) 



S S S „ , 

I TT. I r.,^ I P." V 

j=l J j=l )i=l 



n 1 

where p~ is the probability of a student transferring from state j 

J ^ 

to state £ in n-1 time intervals. Thus, the expected value of an 
instruction program when testing is done every N time units is 



EV(N) 



n^+N 



n=n^+l 

0 



S 

•Vo 

J = 1 



^ ""ik ^ '-i£ 

C=1 0*^ £=1 0*^ 



I V 



£k 



6.7 Testing frequency - The optimal testing frequency N* under 

the assumptions of model 3 is that N which maximizes 

no-*-N / S S S 



(6.7.1) 



EV(N) - m _ 
N 



mo-tm /• o -3 -3 „ 

I \ I I r.. I P 

n=nV I j=l ^ k=l £=1 






- m 



The next section presents a computational example of the above function for 
the case S = 2 . 



7.0 Computational Example for Model 3 

Because of the complexity of equation (6.7.1) and because of the 
number of parameters involved, S = 2 was chosen to generate some data for 
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model 3. With S = 2, the following reduction in the number of parameters 
occurs . 

rii = 1 - ri , ri2 = 1^1 , r2i = r2» <^22 ^ “ *^2 ’ 

Thus, r. is the probability of assigning a student in state j to activ- 
«3 

ity k, k j . 



P "! 1 1 ” o ( i , P "|2 ~ ’ ^21 ~ °^ 2 ’ ^22 ~ ^ ” °^2 " 

Thus, a. is the probability of a student in state j transferring to 
J 

state k, k ^ j, in one time interval. 

^ ”1 

^1 a -| ^2 * °^1 ^ ^2 

»1 and 1^2 ane the steady state probabilities of a student being in each 
state. 



n-l 


‘'2 ^ 


“l ( 1 - 


■“1 


-a2)" 


n-l 


“1 


a-| (1 


■“1 


- 0 . 2 * 


11 


a-| + a2 


“1 


+ 


“2 


Pi 2 


ot *1 (^2 


“1 


+ 


“2 


n-l 


^2 




-ai 


-^ 2 )" 


n-l 


- + 


a2(l 


■“1 


- 02 ) 
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1 

C\J 

+ 

1 


“1 


+ 


“2 


P 22 


a*j + a2 


“1 


+ 


“2 



The derivation of the above expressions can be found in Chapter XVI of 
Fellar [4]. Inserting the above parameters into equation (6.6.1) and 
reducing yields. 
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n-1 



O 

ERIC 



where 



2 2 ? 

(cxi 1x2) 1^1 "" ^ 2 ^ ^ 



2 2 

+ V2i[a-|a2(l - r.| ) + a-|r2] + V22[a-|0(2>^i + 0^2^^ ~ *^2^^ 



and 



((X.J + a2)^^K2 - a-|a2(l “ *^] ~ ^ ^^22 " ^^12 " ^^21^ 



then 



EV(N) = K^ + K2[1 - (1 - - a2)'^] 



Finally, equation (6.7.1) becomes (with n^ = 0) 






EV(N) - m 



+ K2[1 - (I - - a2)'^] - 



m 



Note that N*, the optimal value of N, depends only upon a.j , a 2 » 

n-| + r 2 » and m/[V.|.| + - V 21 ], while ~ depends upon 

the values of ^ 2 * ^l* ^11* ^12* ^21* ^22* ^ • 

The following thoughts went into the selection of the values used in 
the examples. 

(a) Time is in terms of school days. 

(b) $100-$150 per student per subject area per year is approximately 



22 



20 . 



what most school districts spend. = ^22 ~ ^ '^12 " '^21 ' ? 

were chosen. This means that + ^22 ~ ^-]2 ~ ^ 2 ^ ~ ^ ' 

(c) r^ and r 2 range from .01 for an excellent testing program 
to .33 for a very poor testing program. 

(d) and tt 2 range from .01 for a very stable student popula- 
tion and curriculum structure to .25 for a very unstable student popula- 
tion and curriculum structure. 

(e) The cost per test per student (m) ranges from $.10 to $.90. 

The results of the computer analysis are shown in Table 2. For each 



N = 1 to 100 in steps of 1 and found the optimal testing frequency N* . 
The number in the left of the brackets is N* . The number in the right of 
each bracket is the value (in cents per day) of the instructional program 
with a testing frequency of N* . A * in the brackets means that N* 
was not found in the calculations, i.e., N* > 100 . Figure 2 contains a 



of the values of the parameters the computer calculated 




for 



graph of 




as a function of N for m = .3, a-j = 02 = *05, and 



r, + r 



2 



.25 . 



ERIC 



21 . 



References 



1. Atkinson, R. C., Bower, 6. H. , and Brothers, E. J., An Introduction 

to Mathematical Learninq Theory, John Wiley and Sons, New York, 




2. Barlow, R. E., and Proschan, F. , Mathematical Theory of Reliability , 
John Wiley and Sons, 1965. 



3. Cooley, William W., and Glaser, Robert, "An Information and Management 
System for Individually Prescribed Instruction", Learning Research 
and Development Center, University of Pittsburgh, December, 1968. 



4. Fellar, William, An Introduction to Prolaability Theory and Its Applica- 
tions , John Wiley and Sons, New York, 1957. 



5. Flanagan, John C., "Functional Education for the Seventies", Phi Delta 
Kappan , September, 1967, 27-33. 



6. Gorth, W. P., Schrlber, P. E., and O'Reilly, R. P., Training Manual 

for Comprehensive Achievemdnt Moni toring , The New York State Educa- 
ti on Department, Division of Research, Albany, N. Y., June, 1970. 



7. Jerman, Max, and Suppes, Patrick, "A Workshop on Computer-Assisted 
Instruction in Elementary Mathematics", The Arithmetic Teacher, 
March, 1969, 193-197. 



8. Lord, F. M. , and Novick, M. R. , Statistical Theories of Mental Test 
Scores , Addison-Wesley , Boston, 1968. 



9. Pinsky, Paul D., "Mathematical Models Concerning the Measurement of 

Educational Achievement Levels", Ph.D. dissertation. Department of 
Operations Research, Stanford University, May, 1971. 



10. Pinsky, Paul D., "Feedback Information in the Comprehensive Monitoring 

of Educational Achievement", A paper presented at the 11th American 
Meeting of the Institute of Management Sciences, Los Angeles, 

October, 1970. 

11. Suppes, Patrick, and Morningstar, Mona, "Technical Inovations : Computer- 

Assisted Instruction and Compensatory Education", in F. Korten, S. 
Cook, and J. Lacey (Eds.), Psychology and the Problems of Society , 
American Psychological Association, Inc. , Washington, D. C. ,’ TSVo. 




2 ^ 





ba^ 

E 


.001 


.003 


.010 


.030 




.10 


05 


m 


= .la 


[15, 94' 


[9, 93] 


[5, 91] 


[3, 88' 




[2, 83] 


m 


= .3a 


[27, 93 ; 


[16, 91] 


[9, 88] 


[6, 84 




[3, 75] 


m 


= .5a 


[36, 92 


[21, 90] 


[12, 86] 


[7, 81] 




[5, 70] 


m 


= .7a 


[43, 92' 


[25, 90] 


[14, 85] 


[9, 78] 




[6, 66] 


m 


= .9a 


[48, 91' 


[28, 89] 


[16, 84] 


[11, 76] 


[7, 63] 



bo^ = .15 



m = .la 


[18, 


87' 




[10, 


86' 




[6, 84] 


■ 3 , 82' 




[2. 


77' 


m = .3a 
m = .5a 


30, 

[40, 


86 

85] 




18, 

[23, 


84' 

83‘ 




10, 82] 
[13, 80, 




'6, 77' 

‘8, 75 I 




‘k 


70' 

65' 


m = .7a 
m = .9a 


[48, 

[54, 


85' 

84 




28, 

[32, 


83' 

82' 




16, 79 
[l9, 77 ] 




[10. 72] 
[12. 71] 




62' 

59' 



ba^ = .50 



m = .la 


[25, 70' 


[14, 69] 


[8, 68] 


[5, 66] 




[3. 63] 


m = .3a 


[42, 69' 


[25, 68] 


14, 66] 


1 [8, 63. 




[5. 58] 


m = .5a 


[56, 69" 


[32, 68] 


'18, 65] 


1 [11. 61 


] 


[7. 54] 


m = .7a 


[66, 69" 


[38, 67] 


'22, 64] 


1 [14, 60] 


[9. 52] 


m = .9a 


[75, 68' 


[44, 66] 


'25, 63] 


1 [16„ 58] 


[10, 50] 



bal = 1.50 

m = .la [39, 50j 

m = .3a [70, 49' 

m = .5a [91, 49. 

m = .7a * 

m = .9a * 



'24, 49' 


1 


[13. 48] 


1 [8, 47] 


[42, 49 ; 


! 


[23, 47 


1 [14„ 45] 


[53, 48] 




30, 47 ] 


1 [18„ 44] 


[64. 48] 




[36, 46] 


1 [22 „ 43] 


■ 72 , 47' 




[42, 45] 


1 [26, 42] 



[4, 45] 
[8, 42] 
[11. 40] 
[14, 38] 
[16, 37] 



ba^ = 5.00 



m = 


.la 


[86, 30] 


[51, 


30] 


[28, 


29' 


[16, 


29' 


[9. 


28] 


m = 


.3a 


★ 


[88, 


29] 


49, 


29 


[29, 


28' 

B 


[17. 


26] 


m = 


.5a 


★ 


★ 




[64, 


29 


[38, 


27 


[23, 


25] 


m = 


.7a 


★ 


★ 




[76, 


28' 


[46, 


27 


[28, 


25] 


m = 


.9a 


★ 


★ 




[87, 


28' 


[53, 


27] 


[33, 


24] 



[T*, the optimal testing frequency. The optimal value of the instruc- 
tional program in cents per day] 

Computational Example for Model 2 

Table 1 
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[N*. the optimal testing frequency. The optimal value of the instruc- 
tional program in cents per day] 

Computational Example for Model 3 
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